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(54) Method, software product and system for reproducing video/audio data 



(57) A memory in a video/audio-processing unit re- 
tains data of video and audio received from a video mail 
system and data of new input video and audio. Accord- 
ing to user operations, a video/audio-processing unit 
creates metadata. The metadata includes range data 
representing a quotation range or ranges of the received 
video and audio, and information that represents the ar- 



rangement order of the new input video and audio. In 
response to the received video and audio , the video mail 
system transmits only the metadata and the new input 
video and audio to a video mail system. According to 
the contents of the metadata, the video mail system us- 
es the transmitted video and audio and thereby repro- 
duces the overall new video and audio. 
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Description 

[0001 ] The present invention relates to a video/audio- 
creating method and a video/audio-creating system. (In 
this document, "video/audio" means "video and/or au- 
dio".) 

[0002] Recently, video cameras and personal com- 
puters for home-use (PCs) are widely used, and an in- 
creasing number of people perform Internet-based com- 
munication using video/audio. A representative exam- 
pie of the types of media used in for communication are 
electronic mails. Recently, electronic mails frequently 
exchanged include not only simple text data, but also 
video/audio. 

[0003] In ordinary communication using electronic 
mail containing only text data, the contents of a received 
electronic mail are quoted to create a response mail. 
Thereby, pseudo-Interactive communication is imple- 
mented. However, a method for sending a response 
mail quoting video/audio has not been developed to 
date. If a method is realized to enable an electronic mail 
containing video/audio to be quoted in a response mail 
as in the case of an electronic mail containing only text 
data, the usability thereof is considered to be significant- 
ly greater. 

[0004] In the development of a method that enables 
video/audio received in an electronic mail to be quoted 
in a response mail, a major technical problem arises in 
how to reduce the amount of communication data. Gen- 
erally, since video/audio is composed of a relatively 
large amount of data, a simple exchange of electronic 
mails using video/audio requires much communication 
time and cost. 

[0005] Recently, television-based video/audio broad- 
casts can be recorded and stored as digital data in a PC 
or on a home-use server. Thereby, personal editorial 
processing is popularly performed for video and audio. 
Also in this case, since the amount of video/audio data 
is large, a reduction in the amount of data to be stored 
would be advantageous in miniaturization of a storage 
device and in the reduction of costs. 
[0006] The present invention is made in view of the 
above-described problems. Accordingly, an object of 
the invention is to provide a video/audio-creating meth- 
od and a video/audio-creattng system that allow for a 
significant reduction in the amount of data, for example, 
transmitted in an electronic-mail communication and the 
amount of data to be stored in a storage device. 
[0007] In order to achieve the above object, the 
present invention provides a method of reproducing a 
video/audio data set. The method comprises the steps 
of: (1 ) storing first data set of a video/audio data set into 
first memory; (2) copying the first data set from the first 
memory to second memory; (3) designating one or plu- 
ral ranges in the first data set and a sequence of the 
ranges on the second memory; (4) sending the ranges 
and the sequence from the second memory to the first 
memory; and (5) reproducing the ranges in order of the 



sequence with reference to the first memory. 
[0008] In the method, the second memory may store 
one or plural second data set(s) at the step (1). in this 
case, one or plural ranges in the first data set, and a 

5 sequence of the ranges and the second data set(s) are 
designated with reference to the second memory at the 
step (3). Third data set (metadata), which represents the 
ranges and the sequence and which includes the sec- 
ond data set(s), is generated with reference to the first 

^0 memory. The third data set is sent from the second 
memory to the first memory at the step (4) . And the rang- 
es of the first data set and the second data set(s) are 
reproduced in order of the sequence with reference to 
the first memory. 

'5 [0009] In the method, at least one of the data sets 
transmitted between the first and second memories may 
be attached to an electronic mail. 
[0010] In the method, the first and second memories 
may be embedded on different terminal devices from 

20 each other. Otherwise., the first and second memories 
may be embedded on different server devices from each 
other. 

[0011] In the method, the first data set stored on the 
first memory at the step (1) may be previously received 
25 as broadcast video/audio. The step (5) may be made in 
order to broadcast the ranges of the first data set in order 
of the sequence. 

[001 2] Furthermore, in order to achieve the above ob- 
ject, the present invention provides a software product 

30 for reproducing a video/audio data set by computer. The 
software product comprises the processes of: (1 ) storing 
first data set of a video/audio data set into first memory; 
(2) copying the first data set from the first memory to 
second memory; (3) designating one or plural ranges in 

35 the first data set and a sequence of the ranges on the 
second memory; (4) sending the ranges and the se- 
quence from the second memory to the first memory; 
and (5) reproducing the ranges in order of the sequence 
with reference to the first memory. 

40 [0013] In the software product, the second memory 
may store one or plural second data set(s) at the proc- 
ess (1 ) . in this case, one or plural ranges in the first data 
set, and a sequence of the ranges and the second data 
set(s) are designated with reference to the second 

45 memory at the process (3). Third data set, which repre- 
sents the ranges and the sequence and which includes 
the second data set(s), is generated with reference to 
the first memory. The third data set is sent from the sec- 
ond memory to the first memory at the process (4). And 

50 the ranges of the first data set and the second data set 
(s) are reproduced in order of the sequence with refer- 
ence to the first memory. 

[001 4] In the software product, at least one of the data 
sets transmitted between the first and second memories 
55 may be attached to an electronic mail. 

[0015] In the software product, the first and second 
memories may be embedded on different terminal de- 
vices from each other. Otherwise, the first and second 
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memories may be embedded on different server devices 
from each other. 

[001 6J In the software product, the first data set stored 
on the first memory at the process (1 ) may be previously 
received as broadcast video/audio. The process (5) may 5 
be made in orderto broadcast the ranges of the first data 
set in order of the sequence. 

[0017] And furthermore, in order to achieve the above 
object, the present invention provides a system for re- 
producing a video/audio data set by computer. The sys- 10 
tern comprises: first memory for storing first data set of 
a video/audio data set; second memory for being copied 
the first data set from the first memory; a unit for desig- 
nating one or plural ranges in the first data set and a 
sequence of the ranges on the second memory; a unit '5 
for sending the ranges and the sequence from the sec- 
ond memory to the first memory; and 

a unit for reproducing the ranges in order of the 
sequence with reference to the first memory. 
[0018] In the system, the second memory may store 20 
one or plural second data set(s). In this case, the unit 
for designating designates one or plural ranges in the 
first data set, and a sequence of the ranges and the sec- 
ond data set(s) with reference to the second memory. 
The system further comprises a unit for generating third 25 
data sent which represents the ranges and the se- 
quence and which includes the second data set(s) with 
reference to the first memory. The unit for sending sends 
the third data set from the second memory to the first 
memory. And the unit for reproducing reproduces the 30 
ranges of the first data set and the second data set(s) 
in order of the sequence with reference to the first mem- 
ory. 

[0019] In the system, at least one of the data sets 
transmitted between the first and second memories may 35 
be attached to an electronic mail. 
[0020] In the system, the first and second memories 
may be embedded on different terminal devices from 
each other. Otherwise, the first and second memories 
may be embedded on different server devices from each *o 
other. 

[0021] The system may further comprise a unit for re- 
ceiving broadcast video/audio. In this case, the first 
memory stores received video/audio by the means for 
receiving as the first data set. 45 
[0022] The system may further comprise a unit for 
broadcasting which broadcasts reproduction of the 
means for reproducing. 

[0023] Accordingly, to reproduce the new video/audio 
including at least one portion of the first video/audio, the so 
present invention requires only the metadata and the 
second video/audio, but does not require connected da- 
ta of the portion of the data of the first video/audio and 
the data of the second video/audio. 

[0024] Also, to create the new video/audio in re- 55 
sponse to video/audio transmitted via an electronic mail 
by quoting at least one portion of the received video/ 
audio, only the metadata and video/audio to be added 



needs to be transmitted. Therefore, communication da- 
ta can be significantly reduced. 

[0025] Furthermore, even to create new video/audio 
for transmission, the second memory is used to store 
only new video/audio data to be added and the metada- 
ta. Therefore, the invention is advantageous in reducing 
required capacity of the memory device or storage de- 
vice. 

Fig. 1 is a schematic view of a set of video mail sys- 
tems as an example of a video/audio-creating sys- 
tem according to a first embodiment of the present 
invention; 

Fig. 2A is a schematic view showing contents of 

original video and audio data; 

Fig. 2B is a schematic view showing the contents 

of video/audio data created by quoting the original 

video/audio data shown in Fig. 2A; 

Fig. 3 shows example contents of metadata used in 

the video mail system shown in Fig. 1 ; and 

Fig. 4 is a schematic view of a video/audio-editing 

system according to a second embodiment of the 

present invention. 

[0026] Hereinbelow, embodiments of the present in- 
vention will be described with reference to the accom- 
panying drawings. 

[0027] Fig. 1 is a schematic view of a set of video mail 
systems as an example of a video/audio-creating sys- 
tem according to a first embodiment of the present in- 
vention. Fig. 2A is a schematic view showing the con- 
tents of original video and audio data transmitted from 
a user 1 and received by a user 2. Fig. 2B is a schematic 
view showing the contents of video/audio data created 
by quoting portions of the original video/audio data 
shown in Fig. 2A and by adding new video/audio. Fig. 3 
shows example contents of metadata used in the video 
mail systems shown in Fig. 1. Hereinbelow, referring to 
these drawings, a description will be made regarding the 
example video/audio-creating system and a video/au- 
dio-creating method according to the embodiments of 
the present invention. 

[0028] As shown in Fig. 1 , video mail systems 2 and 
4 according to the first embodiment are connected to- 
gether via, for example, the Internet 6. The video mall 
systems 2 and 4 have the same configuration. The con- 
figuration includes a receiving unit 8, a transmitting unit 
1 0, a memory 1 2, and a video/audio-processing unit 14. 
[0029] Through the Internet 6, the receiving unit 8 re- 
ceives an electronic mail including video/audio : that is, 
a video mail. 

[0030] The memory 1 2 (one of first and second storing 
units according to the present invention) stores video 
mails received by the receiving unit 8, video mails being 
edited, and transmitted video mails. 
[0031] The video output unit 16 and the audio output 
unit 18 generate video signals and audio signals, re- 
spectively, from data of the received video mail, the vid- 



3 



LNSDOCID: <EP 1154647A2J_> 



< 

5 



EP 1 154 647 A2 



6 



eo mail being edited, and the transmitted video mail. 
Thereby, the video output unit 16 and the audio output 
unit 18 reproduce video and audio, respectively. 
[0032] Through the Internet 6, the transmitting unit 10 
transmits the video mail created by sending to one of 5 
the video mail systems 2 and 4. 

[0033] Using the video/audio data stored in the mem- 
ory 12, the video/audio-processing unit 14 creates the 
video mail that will be transmitted, and generates infor- 
mation required for playback of the video/audio. The vid- 10 
eo/audio-processing unit 14 forms a range-data gener- 
ating unit, a metadata-generating unit, and a reproduc- 
ing unit, as described below in detail. 
[0034] A video input unit 20 and an audio input unit 

22 take out video signals and audio signals, respective- is 
ly, from outside sources, and feed them into the video/ 
audio-processing unit 14. 

[0035] A controller 23 functions as an interface with a 
user, A user-issued command is input through a user 
interface (not shown), such as a keyboard, a mouse, or 
a microphone. The controller 23 transfers the command 
to the video/audio-processing unit 14, a video output 
unit 16, and an audio output unit 1 8. Also, the controller 

23 outputs a response from the video/audio-processing 
unit 14 or the like to a playback apparatus (not shown). 
[0036] Hereinbelow, a description will be made re- 
garding operations of the video mail systems 2 or 4 in- 
dividually configured as described above. The descrip- 
tion is made on the assumption that communication is 
performed as follows. A user of the video mail system 2 
first sends a video mail to the video mail system 4. A 
user of the video mail system 4 receives the video mail, 
creates a new response video mail by quoting at least 
one portion of the received video mail, and transmits the 
created response video mail to the user of the video mail 
system 2. 

[0037] For the user of the video mail system 2 to trans- 
mit video mail, the user first inputs a video signal and 
an audio signal which will be transmitted through the vid- 
eo input unit 20 and the audio input unit 22, respectively. 
The video/audio-processing unit 14 once stores the in- 
put video signal and the input audio signal as retrievable 
video data and retrievable audio data, respectively, by 
using the memory 12. Subsequently, the video/audio- 
processing unit 14 reads the data from the memory 12 
and feeds the data in a predetermined form of video mail 
to the video mail system 4 through the Internet 6. 
[0038] In the video mail system 4, the video mail is 
received by the receiving unit 8, and the data thereof is 
stored in the memory 12. The video/audio-processing 
unit 14 in the video mail system 4 analyzes the video 
mail data stored in the memory 1 2. In this case, the video 
mail is assumed to be simply formed of ordinary video/ 
audio data. Therefore, the video/audio-processing unit 
14 reports simple information regarding, for example, 
the stored position in the memory 12, to the controller 
23. The controller 23 reports the aforementioned infor- 
mation to the video output unit 16 and the audio output 



unit 1 8. Thereby, the controller 23 controls the video out- 
put unit 1 6 and the audio output unit 1 8 to reproduce the 
video/audio from the video signal and the audio signal 
according to the respective video data and audio data 
that are stored in the memory 12. 
[0039] The user of the video mail system 4 creates a 
response by quoting the video/audio included in the re- 
ceived video mail. To create the response, while viewing 
the video reproduced on the video output unit 1 6 and/or 
hearing the audio reproduced on the audio output unit 
18, the user simultaneously operates the user interface 
by, for example, the aforementioned keyboard, and 
thereby specifies quotation ranges of the video/audio. 
[0040] A range-specifying operation is passed to the 
video/audio-processing unit 14 through the controller 
23. According to a signal received from the controller 
23, the video/audio-processing unit 14 generates range 
data that specifies one or more ranges of the original 
received video/audio (first video/audio according to the 
present invention). For example, the range data can be 
controlled to represent a starttime of the received video/ 
audio to be M O u . Fig. 2A shows examples of video and 
audio transmitted from the user of the video mail system 
2 to the user of the video mail system 4. In the figure, 
the ranges of video and audio shown by (1 )-1 and (1 )-2 
are selected by the user of the video mail system 4 for 
quotation. A start time and a completion time of the 
range shown by (1)-1 are assumed to be, for example, 
"0:00 u and *'0:25\ respectively. A start time and a com- 
pletion time of the range shown by (1)-2 are assumed 
to be, for example, "3:00" and 3:45, respectively. Ac- 
cording to the times, the video/audio-processing unit 14 
generates the aforementioned range data. 
[0041] Subsequently, through the video input unit 20 
and the audio input unit 22, the user of the video mail 
system 4 inputs video/audio data (second video/audio 
according to the present invention) that will be added to 
the aforementioned video/audio selected for quotation. 
The video/audio-processing unit 14 receives the data, 
and once stores the data by using the memory 12. In 
addition, through the controller 23, the video/audio- 
processing unit 1 4 controls the video output unit 1 6 and 
the audio output unit 1 8 to reproduce the video and au- 
dio according to the data stored in the memory 12. 
[0042] While viewing and hearing the reproduced vid- 
eo and audio, the user of the video mail system 4 simul- 
taneously operates the user interface, such as the key- 
board, and thereby issues commands to the video/au- 
dio-processing unit 14 through the controller 23. The 
commands are issued to specify, for example, new vid- 
eo and audio to be added, the order of arrangement of 
the video and audio to be added, and the video and au- 
dio to be quoted. 

[0043] Fig. 2B schematically shows an example video 
and audio to be created through the operation described 
above. In the examples, the aforementioned video and 
audio shown by (1)-1 are arranged as the video and au- 
dio to be quoted first. Subsequently, input new video and 
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audio shown by (2)-1 are arranged. Furthermore, the 
aforementioned video and audio shown by (2)-1 and in- 
put new video and audio shown by (2)-2 are subse- 
quently arranged in that order 

[0044] According to the commands issued by the us- 
er, the video/audio-processing unit 14 generates meta- 
data. The metadata includes the range data generated 
for the video and audio received from the video maii sys- 
tem 2 t specification data that specifies the video and au- 
dio (2)-1 and (2)-2, specification data that specifies the 
video and audio received from the video mail system 2, 
and information representing the arrangement order of 
the aforementioned video/audio. 

[0045] For example, the metadata is composed of text 
data, of which the contents are illustrated in Fig. 3. In 
Fig. 3, specification data 24 represents the video and 
audio that will be quoted, and specification data 26 rep- 
resents the new video and audio to be added and trans- 
mitted, in addition, pieces of range data 28 and 30 (right 
side in Fig. 3) are arranged, which individually corre- 
spond to the specification data 24. For the specification 
data 26, an identification number27 is arranged, it iden- 
tifies at least one portion of the video and audio repre- 
sented by the specification data 26. 
[0046] Sets of the specification data 24 and 26, the 
range data 28 and 30, and the identification number 27 
are sequentially arranged downwards. The order of the 
arrangement represents the order in which playback of 
the video and audio is performed. 
[0047] Subsequently, according to commands input 
by the user through the controller 23, the video/audio- 
processing unit 14 in the video mail system 4 reads the 
above-described metadata and additional video/audio 
data from the memory 12. Subsequently, the video/au- 
dio-processing unit 14 incorporates all the aforemen- 
tioned read data into a data package and feeds it to the 
transmitting unit 10. The data is then transmitted from 
the transmitting unit 10 to the video mail system 2 
through the Internet 6. 

[0048] In the video mail system 2, the transmitted data 
is received by the receiving unit 8, and the received data 
is stored in the memory 12. Then, the video/audio- 
processing unit 14 analyzes the data received and 
stored in the memory 12. In this case, the received data 
includes the metadata, and the metadata includes the 
specification data 24 (shown in Fig. 3) representing the 
transmitted video and audio. According to the transmit- 
ted video mail data stored in the memory 12, the video/ 
audio-processing unit 14 notifies the controller 23 of 
stored positions corresponding to the range data 28 and 
30. 

[0049] In addition, according to the specification data 
26 and the above-described identification number 27, 
the video/audio-processing unit 1 4 notifies the controller 
23 of positions in the memory 12 in which the received 
video and audio data are stored. 

[0050] Moreover, according to the arrangement order 
of the sets of the specification data 24 and 26, the range 



data 28 and 30, and the identification number 27, the 
video/audio-processing unit 14 notifies the controller 23 
of the playback order. 

[0051] According to the aforementioned information, 
5 the controller 23 controls the video output unit 16 and 
the audio output unit 18 so that a playback of the video 
and audio specified by the video/audio-processing unit 
14 in the specified order is performed. 
[0052] Under the aforementioned control, from the 
10 memory 12, the video output unit 1 6 and the audio out- 
put unit 1 8 retrieve the video and audio data represented 
by the range data 28 and 30 in the video and audio data 
represented by the specification data 24 included in the 
aforementioned metadata. In addition, from the memory 
is 12, the video output unit 1 6 and the audio output unit 1 8 
retrieve the video and audio data specified by the spec- 
ification data 26 included in the metadata. Then , the vid- 
eo output unit 16 and the audio output unit 18 generate 
and output signals of the video and signals of the audio, 
respectively, according to the order in which the sets of 
specification data 24 and 26 and the range data 28 and 
30 are arranged. 

[0053] As described above, according to the present 
embodiment, in the video mail system 2, the new video 
and audio that include the quoted portions of the original 
video and audio transmitted in the early stage from the 
video mail system 2 can be reproduced overall only by 
receiving the new video and audio data added in the vid- 
eo mail system 4 and the metadata. 
[0054] Thereby, according to the present embodi- 
ment, in the video mail system 4 when transmitting a 
new response video mail containing quoted portions of 
the received video and audio, the amount of data to be 
transmitted can be significantly reduced. 
[0055] According to the present embodiment, the vid- 
eo mail is created such that after all the ranges of the 
video and audio to be quoted are selected, the new vid- 
eo and audio to be added are specified. However, the 
procedure may of course be modified. For example, the 
video mail may be created in the following order. The 
video and audio shown by (1)-1 are first selected, and 
the video and audio to be added and inserted are then 
selected. Thereafter, the video and audio shown by (1)- 
2 are selected, and subsequently, the video and audio 
to be added and inserted are selected. 
[0056] Hereinbelow, a description will be made re- 
garding a second embodiment of the present invention. 
[0057] Fig. 4 is a schematic view of a video/audio-ed- 
iting system 36 according to the second embodiment of 
the present invention. In Fig. 4, the same reference nu- 
merals as those in Fig. 1 are used for the same portions 
as those shown therein. 

[0058] A video/audio-processing unit 32 is the same 
as the memory 1 2 except that it does not have commu- 
nication-related functions. 

[0059] The video/audio-editing system 36 of the sec- 
ond embodiment can be effectively used, for example, 
in a case where television-broadcast video and audio 
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are recorded, and the recorded video and audio are 
partly used to create a new video and audio. 
[0060] Specifically, the data of the aforementioned re- 
corded video and audio is stored in the memory 12 as 
video data corresponding to the data of the video and 
audio data stored in the memory 1 2 when the video mail 
is received in the video mail system 4 from the video 
mail system 2. As in the same manner as described 
above, the new video and audio to be added are input 
through the video input unit 20 and the audio input unit 
22. Then, the video/audio-processing unit 32 once 
stores the data of the video and audio by using the mem- 
ory 12. 

[0061] Subsequently, as in the case of the video mail 
system 4, a user operates a user interface (not shown), 
such as a keyboard (not shown), to create the video and 
audio as shown in Fig. 2B. In response to the user op- 
eration, the video/audio -processing unit 32 creates 
metadata, and packetizes the metadata and the input 
new video and audio data. 

[0062] According to the packetized metadata and the 
input new video and audio data, the video/audio- 
processing unit 32, which functions as a reproducing 
unit, controls the video output unit 1 6 and the audio out- 
put unit 18 through the controller 23 to reproduce the 
new video and audio created with at least one portion 
of the video and audio recorded and stored in the mem- 
ory 12 and the input new video and audio. 
[0063] Therefore, in the second embodiment, the 
memory 12 is used to store only the data of the video 
and audio to be added and the metadata in order to cre- 
ate the new video and audio. Therefore, the storage ca- 
pacity of the memory 12 may be small. 
[0064] In addition, in this embodiment, the recorded 
video and audio are used to obtain the above-described 
effects. However, the video/audio-editing system 36 of 
the present embodiment may be used in the stage 
where prebroadcast video and audio are edited in a 
broadcasting station. This also allows for effects equiv- 
alent to those described above to be obtained. 
[0065] Hereinbelow, a third embodiment of the 
present invention will be described. 
[0066] A case can arise in which after a broadcast vid- 
eo/audio is recorded, communication, such as that in a 
"TV community" (according to Japanese Patent Appli- 
cation No. Hei 11-330042, namely, 330042/1999), is 
made with a different broadcast-program viewer who re- 
corded the video/audio, and messages are exchanged 
by quoting the recorded video/audio and adding the new 
video/audio. Even in this case, when metadata similar 
to that according to the first or second embodiments is 
used, only added new portions of the video and audio 
are required to be exchanged. 

[0067] In addition, the configuration may be modified 
to include a server system that can be accessed by a 
plurality of persons through communication lines. In this 
case, the original video/audio data to be quoted is stored 
in the same server system, and the new video/audio da- 



ta to be added is stored in the server system together 
with the metadata. According to this configuration, a plu- 
rality of persons can obtain the portions quoted from the 
original video/audio data, the added video/audio data, 
5 and the metadata from the server system to reproduce 
the video/audio. 

[0068] As described above, the present invention can 
reproduce the new video/audio including at least one 
portion of the first video/audio only by using the meta- 

10 data and the second video/audio data without using con- 
nected data of the portion or portions of the first video/ 
audio and the second video/audio data, 
[0069] To create the new video/audio in response to 
the video/audio transmitted via an electronic mail by 

15 quoting the portion or portions of the received video/au- 
dio, only the metadata and the video/audio to be added 
need to be transmitted. Therefore, the amount of com- 
munication data can be significantly reduced. 
[0070] Furthermore, according to the present inven- 

20 tion, even to create the new video/audio for transmis- 
sion, the storing unit is used to store only the new video/ 
audio data to be added and the metadata. Therefore, 
the invention is advantageous in reducing required stor- 
age capacity of the storing unit. 

25 

Claims 

1. A method of reproducing a video/audio data set, 
30 comprising the steps of: 

(1) storing first data set of a video/audio data 
set into first memory; 

(2) copying the first data set from the first mem- 
35 ory to second memory; 

(3) designating one or plural ranges in the first 
data set and a sequence of the ranges on the 
second memory; 

(4) sending the ranges and the sequence from 
40 the second memory to the first memory; and 

(5) reproducing the ranges in order of the se- 
quence with reference to the first memory. 

2. The method claimed in claim 1, wherein: 

45 

the second memory stores one or plural second 
data set(s) at the step (1 ); 
one or plural ranges in the first data set, and a 
sequence of the ranges and the second data 

50 set(s) are designated with reference to the sec- 

ond memory at the step (3); 
third data set, which represents the ranges and 
the sequence and which includes the second 
data set(s) ,is generated with reference to the 

55 first memory; 

the third data set is sent from the second mem- 
ory to the first memory at the step (4); and 
the ranges of the first data set and the second 
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data set(s) are reproduced in order of the se- 
quence with reference to the first memory. 

The method claimed in claim 1 or 2. wherein at least 
one of the data sets transmitted between the first 5 
and second memories is attached to an electronic 
mail. 

The method claimed in claim 1 , 2 or 3, wherein the 
first and second memories are embedded on differ- 10 
ent terminal devices from each other. 

The method claimed in claim 1 , 2 or 3, wherein the 
first and second memories are embedded on differ- 
ent server devices from each other. is 



The method claimed in any one of claims 1 to 5 t 
wherein the first data set stored on the first memory 
at the step (1) is previously received as broadcast 
video/audio. 20 13. 



30 



The method claimed in any one of claims 1 to 6, 
wherein the step (5 is made in order to broadcast 
the ranges of the first data set in order of the se- 
quence. 25 

A software product for reproducing a video/audio 
data set by computer, comprising the steps accord- 
ing to method of any one of claims 1 to 7. 

A system for reproducing a video/audio data set by 
computer, comprising: 

first memory for storing first data set of a video/ 
audio data set; 35 
second memory for being copied the first data 
set from the first memory; 
means for designating one or plural ranges in 
the first data set and a sequence of the ranges 
on the second memory; 40 
means for sending the ranges and the se- 
quence from the second memory to the first 
memory; and 

means for reproducing the ranges in order of 
the sequence wjth reference to the first memo- 45 
ry. 



second data set(s) with reference to the first 
memory; 

the means for sending sends the third data set 
from the second memory to the first memory; 
and 

the means for reproducing reproduces the 
ranges of the first data set and the second data 
set(s) in order of the sequence with reference 
to the first memory. 

11. The system claimed in claim 9 or 10, wherein at 
least one of the data sets transmitted between the 
first and second memories is attached to an elec- 
tronic mail. 

12. The system claimed in claim 9, 10 or 11, wherein 
the first and second memories are embedded on 
different terminal devices from each other. 



The system claimed in claim 9, 10 or 11, wherein 
the first and second memories are embedded on 
different server devices from each other. 



14. The system claimed in any one of ciaims 9 to 13, 
comprising means for receiving broadcast video/ 
audio, wherein the first memory stores received vid- 
eo/audio by the means for receiving as the first data 
set. 

15, The system claimed in any one of ciaims 9 to 14, 
comprising means for broadcasting which broad- 
casts reproduction of the means for reproducing. 



The system claimed in claim 9, wherein: 



the second memory stores one or plural second so 
data set(s) ; 

the means for designating designates one or 
plural ranges in the first data set, and a se- 
quence of the ranges and the second data set 
(s) with reference to the second memory; 55 
the system further comprises means for gener- 
ating third data sent which represents the rang- 
es and the sequence and which includes the 
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